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Section 13 



Martingales. Doob's Decomposition. 
Uniform Integrability. 



Let (fl,B,F) be a probability space and let (T, <) be a linearly ordered set. Consider a family of cr-algebras 
B t ,teT such that for t < u, B t <Z B u <Z B. 

Definition. A family (X t ,B t )teT is called a martingale if 

1. X t : fl — > R is measurable w.r.t. B t ; in other words, X t is adapted to 23 t . 

2. E|X t | < co. 

3. E{X u \B t ) = X t for f < u. 

If the last equality is replaced by E(X u \B t ) < X t then the process is called a supermartingale and if 
E(X u \B t ) > X t then it is called a submartingale. 
Examples. 

1. Consider a sequence (X n ) n >i of independent random variables such that EXi = and let S n = 
J2i< n Xi- If B n = a(Xi, . . . , X n ) is a cr-algebra generated by the first n r.v.s then (S n7 B n ) n >i is a martingale 



Definition. If (X n ,B n ) is a martingale and for some r.v. X, X n = E(X\B n ), then the martingale is called 
right- clo sable. If Xoo = X, Boo = # then (X n , B n ) n <oo is called right-closed. 

3. Let (Xj)j>i be i.i.d. and let S n — J2i< n ^i- Let us take T = {. . . , —2, —1} and for n > 1 define 



since 



E(S n+1 \B n ) = E(X n+1 + S n \B n ) = + S n = S, 



2. Consider a sequence of cr-algebras 



...cB m c6„c...c6 



and a r.v. X on B and let 



X„ = E(X\B n ). Then (Jf„,B n ) is a martingale since for m < n 
E(X n \B m ) = E(E(X\B n )\B m ) = E(X\B m ) — X m . 




)• 



Therefore, 



S n = E(S n \B- n )= ^ E(X fc |B_ n )=nE(Xi|B_ n )=>.Z. 



5, 



7), 



E(Xi|B_„). 



— n 



n 



l<fe<n 
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Thus, (Z- n , B- n )-n<-i is a right-closed martingale. 

□ 

Lemma 28 Let f : M — ► R 6e a convex function. Suppose that either one of two conditions holds: 

1. (X t ,B t ) is a martingale, 

2. (X t ,Bt) is a submartingale and f is increasing. 
Then (f(X t ),B t ) is a submartingale. 

Proof. 1. For t < u, by Jensen's inequality, 

f(X t ) = f(E(X u \B t )) < E(f(X u )\B t ). 
2. For t < u, since X t < E(X u \B t ) and / is increasing, 

f(X t ) < f(E(X u \B t )) < E(f(X u )\B t ), 
where the last step is again Jensen's inequality. 

□ 

Theorem 30 (Doob's decomposition) If (X n , B n ) n >o is a submartingale then it can be uniquely decomposed 

X n Z n -\- Y n , 

where (Y n ,B n ) is a martingale, Z a = 0, Z n < Z n+ i almost surely and Z n is B n _i-measurable. 

Proof. Let D n = X n — X n _\ and 

G n - E(D„|B n _i) - E(X n |B n _i) - X„_i > 

by the definition of submartingale. Let, 

H n = D n — G n , Y n = Hi + ... + H n , Z n = G\ + h G n . 

Since G n > a.s., Z n < Z n +i and, by construction, Z n is B n — i-mcasurable. We have, 

E(H n \B n ^) = E(D n \B n ^) -G n =0 

and, therefore, E(Y n \B n -i) = Y n -\- Uniqueness follows by construction. Suppose that X n = Z n + Y n with 
all stated properties. First, since Z = 0, Y = X . By induction, given a unique decomposition up to n — 1, 
we can write 

Z n = E(Z„|B n _!) = E(X n - r„|B n _i) - E(X n |B„_i) - Y n _ x 

and Y n = X n - Z n . 

□ 

Definition. We say that (I„)„>i is uniformly integrable if 

supE|X„|<oo and supE|X„|I(|X n | > M) -> as M -> oo. 

n n 

Lemma 29 T/ie following holds. 

1. If (X n ,B n ) is a right-closable martingale then (X n ) is uniformly integrable. 

2. If (^ ni ^n)n<oo is a submartingale then for any aeM, (max(X„,a)) is uniformly integrable. 
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Proof. l.IfX n = E(Y\B n ) then 

\X n \ = \E(Y\B n )\ < E(|F||B„) and E\X n \ < E\Y\ < oo. 

Since {\X n \ > M} G B n , 

X n l(\X n \ > M) = I(|X„| > M)E{Y\B n ) = E{Yl{\X n \ > M)\B n ) 

and, therefore, 

E\X n \l{\X n \>M)<E\Y\l{\X n \>M) < KV{\X n \> M)+E\Y\l{\Y\> K) 

^ K^+W\I(\Y\ >K)< K^+E\Y\\{\Y\ > K). 

Letting M — > oo, K —> oo proves that sup„ E|X„|I(|X n | > M) — > as M — > oo. 

2. Since (^n,Bn) n <oo is a submartingale, for y = Xrx, we have X n < E(y|S„). Below we will use the 
following observation. Since a function max(a,a;) is convex and increasing in x, by Jensen's inequality 

max(a,X„) < E(max(a, Y)\B n ). (13.0.1) 

Since, 

|max(X„,a)| < \a\ + X n l(X n > \a\) 

and {\X n \ > |o|} G B n we can write 

E|max(X„,a)| < \a\+EX n l(X n > \a\) < \a\ + EYl(X n > \a\) < \a\ +E\Y\ < oo. 
If we take M > \a\ then 

E| max(X„, o)|I(| max(X„, o)| > M) = EX n l(X n > M) < EYl(X n > M) 

< KV(X n > M) + E\Y \I(\Y\ > K) 

< K EmaX ^ 0) +E\Y\l(\Y\>K) 
by (13.0.1) < K Em ^ 0) +E\Y\I(\Y\>K). 

Letting M — > oo and K — > oo finishes the proof. 

□ 

Uniform intcgrability plays an important role when studying the convergence of martingales. The following 
strengthening of the dominated convergence theorem will be useful. 

Lemma 30 Consider r. v. s (X n ) and X such thatE\X n \ < oo,E|X| < oo. Then the following are equivalent: 

1. E\X n -X\ -»0, 

2. (X n ) is uniformly integrable and X n — > X in probability. 
Proof. 2=^1. We can write, 

E\X n -X\ < e + E\X n -X\I(\X n -X\>e) 

< e + 2KP(\X n -X\>e)+ 2E|X„|I(|X„| > K) + 2E\X\l{\X\ > K) 

< e + 2KP(\X n -X\ > e) +2supE|X„|I(|X„| > K) + 2E\X\l(\X\ > K). 

n 

Letting n — » oo and then e —* 0, K — > oo proves the result. 
1=4>2. By Chcbyshev's inequality, 

¥{\X n -X\>e)< l -E\X n - X\ -» 
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as n — > oo so X n — > X in probability. To prove uniform integrability let us first show that for any e > 
there exists S > such that 

¥(A) < 5=>K\X\I A < e. 
Suppose not. Then, for some e > one can find a sequence of events A(n) such that 

F(A(n))<^ and E\X\I A(n) > e. 

Since ^2 n> iP(A(n)) < oo, by Borel-Cantelli lemma, F(A(n) i.o.) = 0. This means that |X|I^(„) — > almost 
surely and by the dominated convergence theorem E|X|I_4( n ) — > - a contradiction. 
Given s > 0, take S as above and take M > large enough so that for all n > 1 

P(|X„| > M) < & < 5. 

Then, 

E|X n |I(|X„| > M) < E|X„ - X| + E|X|I(|X„| > M) < E|X„ -X\ + e. 
For large enough n > n , E|X„ — X| < e and, therefore, 

E|X„|I(|X„| > M) < 2e. 

We can also choose M large enough so that E|X„|I(|X„| > M) < 2e for n < n and this finishes the proof. 

□ 
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